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To test the hypothesis that learning depends on the influence and interaction of 
three primary variables— instruction, learner aptitude, and learning environment— an 
explanatory model was tested during the 1967-68 school year in an expe rime nt 
conducted with the cooperation of a simple random sample of 56 teachers drawn 
from the National Science Teachers Association of 17.000 secondary physics 
teachers. A number of pre- and posttests were administered to all 56 classes, with 
the experimental group of teachers using the Harvard Physics Project materials and 
the control group of teachers using their regular course materials. Findings of the 
study indicate the importance of recognizing not only instruction but also aptitude 
and learning environment as variables significantly affecting learning. (JIO 
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Evaluation of instruction rarely shows a clear superiority of one medium 
or aethod over another (Stephens, 1968). This paper Is an attempt to show that 
auch of the reliable variance in student performance is attributable to the 
aptitude of the learner and the environment of learning, leaving only a saall j 

part to be accounted for by Instructional variables and perhaps by interactions 
between die three factors. Therefore, the design of research on instruction 
should Include analyses of aptitude and environment and their interactions with 
instruction. To the extent that results of such designs are replicated and 
generalised, evaluation will contribute to basic educational research and to the 
f omuls tlon of verifiable principles and theories of instruction. Such a step 
is highly desirable since it is nearly impossible to evaluate all the many new 
media and methods of instruction. 

j 

Aptitude may be defined broadly as any characteristic of the individual or 

J 

hit experience that predicts any learning criterion* Measured intelligence, the 

) 

most general predictor of school learning, typically accounts for 50 to 60 percent 
of the variance in school achievement. About 71 percent (the mean of estimate* 

Tj 

reviewed by Bloom, 1964) of the variance in intelligence itself can be attributed 
to heredity. An estimated 58 percent of the variance in intelligence can be 
predicted from measures of the home environment (Wolf, 1964). in contrast. 
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parental socio-economic status, a such cruder and indirect Mature of the hoM 

environment, typically accounts for about 16 percent of the variance in 

intelligence* ' these environmental sources of variance obviously overlap genetic 

sources of variance, e.g., bright parents have stimulating homes. The home 

envlroMent also predicts about 64 percent of the variance on standardised 

and 

achievement tests (Dave, 1964). From these/other data. Bloom (1964) has shown 
the importance of the child's early envlronent, especially during the first 
five years of life, in determining later achievement. Recent research has shown 
that measured environsmnts of high school physics classes account for from 
10 to 37 percent of the class variance in achievement, understanding, and 
interest criteria and from 9 to 16 percent after intelligence and other aptltudea 
are partlalled out (Walberg, 1968)* The learning environment may be defined aa 
any stinulus, aside from the deliberate instruction in question, that predicts 
learning. The foregoing estimates of variance in learning accounted for by 
heredity and environment are considerably lower than could be accounted for if 
there were no error in measuring learning (see Bloom, 1964, for attenuation 
corrections and other considerations). In any case, there appears to be little 
variance in learning left to be accounted for by instructional differences after 
the effects of aptitude (a function of heredity and prior environment), the 
environment of learning during Instruction, and measurement errors* 

This conclusion is supported by Schuts's (1966) tabulation of the variance 
accounted for by experimental factors in research reported in the Journal of 
Educational Psychology and the American Journal of Educationa l Research in 1964* 
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the median variance accounted for in studies of two group comparisons (t-tests) 
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vat 17 and the Median for studies of three or sore groups (F-tests) was !i. 

As Schuts points out, these figures have a strong upward bias aince editors 
of these Journals reject about 80 petcent of submitted Manuscripts and those 
rejected tend to be nonsignificant studies which account for little or no 
variance in learning criteria. 

Thus, in fomilating research on instruction, estimates of aptitudes and 
learning environments should be included. Such models would have several 
advantages: they would allow a determination of the relative effects of 

important factors; they would Increase the precision and power of the analysis; 
and they would permit an investigation of the interactions of the factors. 

The remainder of this paper proposes such a model and reports some evaluation 
data which Illustrate the potential value of the approach. 

Equations 1 and 2 represent a model of the quasi* functional relationships 
between learning 0^) and instruction (1 1 ), aptitude (A^), the environment of 

I* - f(I,A,E) U) 

I* - f l (I 1 )+f 2 (A J )« 3 (E k )+f 4 (I t A J )+f 5 (I 1 E k )+f 6 CA J B k ) +t 7( I l A J B k ) (2) 

learning (E^, and (in Equation 2) their interactions. The functions of the 
first three terms, the main effects, are individually prominent in the research 
literature. They answer the following questions: Which instruction best promotes 
learning (f., sometimes called **suomative evaluation**)? Which students learn 
best <f 2 , studies of prediction and selection)? Whiah environments best promote 
learning (f^, stimulation and enrichment)? The first interaction, between 
instruction and aptitude (f^) , has been occasionally investigated in curriculum 
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evaluations tod is now being studied intensively by groups at Chicago and 
Stanford. To my knowledge, there are no studies of the second and last inter- 
actions (fj, fy), but Anderson is completing a dissertation at Harvard on the 
interaction of aptitude and environment (f^)* (Interactions are possible within 
each of the first three terms, of course, e.g.* the interaction of media and 
teaching methods in the first term. The model may be expanded to Include these 
more complex possibilities*) Many alternative models of instruction could be 
formulated, tested, and found useful* However, it has been shown that aptitude 
and environment are crucial; instruction must be included by definition. And 
variables from other models could be fitted into the terms of the present model, 
e.g., teacher characteristics and the time allowed for instruction in the first 
term, perseverance in the second term, and the ability to understand given 
instruction in the fourth term. The usefulness of any research model, of course, 
is in its comprehensiveness and capacities to be tested empirically and to 
generate research leading to new hypotheses and implications* Consider a test 
of the proposed model with some evaluation data from a national curriculum 
project* 

Harvard Project Physics is a new high school course. Concerned about the 
steadily declining enrollments in physics (from 26 to 17 percent of high school 
students during the past 15 years), and the apparent failure of special groups 
to learn and appreciate physics, a group of educators and physicists attempted 
to develop a course that would not only appeal to potential scientists and 
technicians, but to those who might not be inclined to study physics, e.g., those 
with less ability and Interest in science. As the course evolved, a number of 
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explicit methods end media were produced to accomplish these ends. A te*t was 
written with a moderate density of physical concepts but with lower reading 
difficulty levels than other courses. Expanding on the idea of branching in 
programed instruction, the text included a number of cognitive modes of learning 
the same concept (or more advanced concepts), e.g., through philosophical 
explanations, mathematical formulations, historical narratives, and graphic 
representations. To arouse motivation in students uninterested in science and 
mathematics, tables, art works, and marginal notes were employed to illustrate 
concepts and their relations to the society and history of ideas. The text also 
allowed the student to pursue his own ideas and interests by referencing other 
instructional materials, a book of coordinated original readings, laboratory 
manuals and apparatus, programed instruction booklets, and film loops. So as 
not to overwhelm teachers or students with diversity but to allow as many 
choices as possible, teacher and student guides were produced which describe the 
organization of the materials and how best to use them for given purposes. It 
was also hoped that such materials and guides would compensate for poor facilities 
of some schools and the inadequacies of some physics teachers. Thus two main 
purposes of the Project are to develop methods and media suitable 1) for different 
students, especially scientifically disadvantaged and 2) for different conditions 
of Instruction, especially those less than optimal. 

In the proposed model for research on instruction, these purposes are 
represented by the instruction-aptitude' and the instruct ion- environment inter- 
action terms (f 4> fj). It can be hypothesized that students with less aptitude 
and those in less desirable learning environments can still attain course 



objectives. To the extent this is confirmed , the course may be Judged a success 
on these criteria. Examined below is an analysis on one criterion, gains in 
physics achievement, representing a small part of the total evaluation of the 
course and a preliminary test of the model. 

Method 

Sample, Testing Procedure, and Instruments 

On the basis of anticipated costs, expected differences in courses, and 
standard deviations of variables in pilot studies, a sample size of 56 teachers 
was chosen. A simple random sample of teachers was drawn from the National 
Science Teachers Association of 17,000 physics teachers in the nation. All had 
agreed to teach Harvard Project Physics or their present course depending on our 
random assignment. Because special studies were planned of the Project teachers, 
about twice as many were assigned to teach the new course. The Project teachers 
were brought to Harvard for training during the summer. To minimize the so-called 
"Hawthorne effect", the control teachers were also brought in for a few days, 
given a cordial explanation of their role, but received no special instruction. 

The teachers jwerc* administered a series of pretests, midtests, and posttesta 
during the first two weeks in the fall term, in December, and the last two weeks 
of the spring term. Using random data collection (Walberg and Welch, 1967) 
random halves of each group took different tests simultaneously, a procedure 
which increaaes the number of instruments administered and decreases testing time 
for each student. However, biographical data were collected on all students in 
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The criterion instrument, the Physics Achievement Test, a 36-item, 
locally-constructed test, was given as a pretest and posttest* Items were 
written and chosen to represent general physics concepts. The Kuder-Richardson 
Formula 20 reliability of the Physics Achievement Test is .77 and the 
regression-adjusted gain score reliability using Traub’s (1967) formula is .42. 
Plots of the gain scores and tests for skewness and kurtosis revealed no 
departure from the normal distribution* Since the test had been given to 
random halves of classes on the two occasions, a quarter of the sample of 
students (N-499) had taken it twice, and were therefore included in the sub-sample. 
Some workers hypothesize special sensitization to treatments may occur in 
experimental groups that are given the same pretest and posttest. However, the 
few empirical studies of the alleged effect contradict this hypothesis. Lana 
(1960) found that pretesting enhanced learning in experimental and control groups 
to a minor extent in a 12-day learning experiment, but the enhancement did not 
favor one group over the other. The sensitization effect is of little concern 
here since there was a long time period, 8 months, between testings. 

A total of 31 aptitude and 17 environment measures thought to influence 
learning were selected for analysis. Among the pretests were measures of science 
understanding and interest in physical science. The Test on Understanding Science 
(Cooley and Klopfer, 1961) is a 60- item multiple-choice test on the nature of 
science, science as an institution, and scientists as people (see Table 3 for 
reliabilities of all measures). The sub-scale of Academic Interest Measure used 
(Halpern, 1965) consists of a number of items describing physical science activi- 
ties, and the respondent is asked to indicate which he would like to do. His 
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affirmative answers are summed for the sub-score « 

In December the following instruments were administered: the Henmon-Helson 

Intelligence Test (Lamke, Nelson, and Kelso, 1960), a selection of personality 
scales from those of Rokeach (1960) and Edwards (1959), and the Learning 
Environment Inventory (Walberg and Anderson, 1967, unpublished)* The environment 
items describe characteristics of high school classes* The student expresses hie 
agreement or disagreement on a 4-point scale* The mean of the items for each 
14 sub-scores is calculated for student, and the mean of the sub-scores of the 
class is calculated for a group estimate of the learning environment* Prior work 
had shown that two weighted combinations of the scores, termed "Cognitive Press" 
and "Non-Cognitive Press," predict these two kinds of learning* They were also 
included in the analysis as was the class size of each student* 

Nineteen multiple-choice items from the Biographical Inventory (Taylor and 
Ellison, 1967) were selected because they tap characteristics and experiences 
that may be related to learning (see Table 3). Lastly, the year in school was 
obtained from student questionnaire data and included in the analysis* 

Analysis 

Frequency distributions of the independent variables (except the biographical 
items) were used to choose cutting points at approximately the 20th and 80th per- 
centiles of the total sample. The biographical items were roughly dichotomized 
at the 50th percentile# About 85 percent of the sample were seniors, so grade 

in school was split between seniors and others* 

\ 

A preliminary least-squares analysis of variance of the course effects on 
boys and girls (see Tables 1 and 2) revealed that Project students gained 
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significantly more (p less than #01) than students In other courses, that girls 

(Tables 1 and 2 about here) 

gained more than boys, and that there was no interaction between sex and course* 
More crucial for the planned analysis is that there were about twice as many girls 
as boys in the sample (reflecting national trends)* Because of the grossly 
unequal cell sizes and because prior work (Walberg, 1969) had shown sharp differ- 
ences in boys* and girls’ reactions to physics, it was decided to analyze the 

groups separately* 

Since the instruction-aptitude and instruction-environment interactions were 
of primary interest, 47 analyses of variance on boys and girls separately were 
computed, a large number but limited in terms of the model and the data available* 
These analyses were for the two course effects by three levels of environment and 
aptitude, except for the biographical items which had two levels* Bach of the 
31 aptitude and 16 environment measures were tested for significance by themselves 
and in their interaction with course* There were minor departures from propor- 
tional cell sizes, and a least-squares analysis for non- orthogonal designs, 
following Bock’s (1963) algorythms, was employed* The effects are confounded in 
this kind of data, the estimates of effects and their significance levels are 
conservative for terms entering the model after other correlated effects. Hence, 
the course effect was entered first since the preliminary analysis showed it to 
be significant; the aptitude and environment terms were entered second in each 
analysis because they were of secondary interest; and the interaction terms were 
entered third as is recommended (Bock, 1963), and also because they were hypo- 
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Results and Discussion 
to 

Before turnlng/the hypothesized interactions, consider the effects of 
aptitudes and environments by themselves (i.e., without classifying students by 
course). The mean achievement gains for the significant trichotomized independent 
variables showed no curvilinear trends, i.e., for middle aptitude or environment 
groups to be higher or lower than both high and low groups. Hence a summary of 
the linear trends is displayed in the tabulation of correlations of the aptitude 
and environment score levels with achievement gains (Table 3). IQ is the only 

(Table 3 about here) 

aptitude that significantly predicts achievement gains for boys and girls. Many 
more of the other variables predicted for boys than for girls. The pattern for 
boys suggests an Intellectual achievement propensity: scoring high on the science 

understanding test, getting superior marks, questioning teachers, entering science 
contests, following projects through, and planning college. Also, boys reporting 
high creative imagination and scoring low on Authoritarianism tended to gain more. 
The pattern is not as clear for girls who gained more: several bookcases in the 

home, entering music contests, and a low need for order. 

The pattern of environment variables that predict gains for both boys and 
girls suggest intellectual challenge and group cohesiveness: high scores on 

Difficulty and Cognitive Press, low scores on Friction. The boys gained less in 
environments perceived as high on Favoritism and Disorganization. 

The smaller sample size for girls may account for the fewer aptitude and 
environment measures that significantly predict their learning. However, recent 
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rtnarcb on hl||i school physics students suggests that girls* docility and 
conforming behavior In school enables them to succeed more In science classes 
(though not In science careers) almost Irrespective of their abilities, interests, 
and classroom conditions (Hslberg, 1969), 

Figures 1-3 shoe the statistically significant interactions (p less than .05) 
of central concern for evaluation of Project Physics, its capacity to promote 

(Figures 1-3 about here) 

learning in different students and learning environments. Figure 1 shows that 
"promising" boys in Project Physics and other courses all gain in physics achieve- 
ment as much as would be predicted from their initial knowledge of physics* 
However, less promising boys in the Project gain as much as or better than would 
be expected, whereas the gains for less promising students in other courses are 
considerably lower— for those with low scores on the physics achievement and 
science understanding pretests, sophomores and juniors, and those who reported 
having less creative imaginations and fewer books In their homes. Project Physics 
also moderates the relationship between the most potent aptitude, IQ, and gains: 
the achievement of boys with less of this aptitude falls off more sharply In 
other courses than Project boys. 

Similar results may be found In Figure 2 for boys In different learning 
environments. Project boys tend to gain more than predicted under most classroom 
environments whereas boys in other courses gain less than would be expected under 
several conditions: when the class is perceived as intimate, diverse, formal, 
moderately satisfying, and paced slowly. 
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course 

There were only two significant/interactions for girls (see Figure 3)« 

The first shows that girls in Project Physics gain more than predicted irrespec- 
tive of year in school* Gif Is in other courses gain less if they are senior a 
and such better than expected if they are juniors or sophomores . Actually the 
latter group is very small (4 of the 115 subjects entering this particular 
analysis) since about 85 percent of the total sample were seniors, and the control 
group is about half the size of the Prbject group* 

The other significant Interaction for girls is complex and concerhed 
Favoritism, the tendency for one student to be above another in the classroom 
hierarchy* Project girls gain more when the class is perceived as having low 
or moderate levels of favoritism; thsy gain less when the class is seen as having 
high levels of favoritism* Girls in other courses gain much less when the class 
is seen as having moderate levels of favoritism* 

Thus it appears from the foregoing analysis of one criterion. Project Physics 
seesm to be generally attaining two of its laiportant objectives: enabling even 
students of relatively low aptitude to learn physics and enabling students in 
general to learn in class environments that hamper students in other courses* 

It must be admitted, however, that the present sample is a fairly bright group; 
the mean IQ la 116, reflecting the national trend for college-bound seniors to 
take physics* A national random sample was necessary to make inferences to the 
national population, but the Project staff are now making clinical studies of 
classes in urban slums to extend the evaluation to groups of lower aptitude than 
could be examined in the main study. It must also be admitted that the present 
evaluation is "molar" rather than "molecular;" it can only be concluded that 
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providing nany node# and methods of learning physics and guides for choosing 
among the options seems to promote learning for a wider variety of students 
and in different environments. It has not been possible to examine the "fine 
structure" of instruction and Investigate the individual options and their inter- 
actions with aptitudes and environments. Comprehensive studies of this order of 
complexity are obviously difficult and time-consuming, certainly beyond present 
resources if not ambitions. 

/ 

Summary and Conclusion 

Aside f vom instruction, learning may be said to depend cn two major classes 
of variables: aptitudes and learning environments. An aptitude may be defined 

broadly and operationally as any characteristic of the individual or his experi- 
ence prior to instruction that predicts learning. The learning environment is 
any stimulus present in the environment, aside from Instruction, that predicts 
learning. A model of research on Instruction is proposed that Includes 
instruction by definition, aptitudes, the learning environments, and their 
interactions. An example of the potential usefulness of the model is taken from 
the evaluation of Harvard Project Physics. Students in the course appear to 
succeed in gaining physics knowledge to some extent irrespective of a number of 
aptitudes and environments whereas students in other courses do not succeed when 
either their aptitudes or learning environments are less than optimal. The model 
points to a number of other relationships worth investigating.* 

*The ideas in this paper have benefited from communications with a number of 
correspondents, colleagues, and students. I thank them for their kindness and 

absolve them of any responsibility for errors in the manuscript. 



Table 1 

Analysis of Variance for Course Effects 
on Physics Achievement Gains for Boys and Girls* 



Source of Variance 


df 


Mean Square 


F-Ratio 


Course 


1 


341.56 


13.72 


Sex 


1 


m.37 


4.47 


Interaction 


1 


10.83 


.44 


Error 


496 


24.90 




Total 


499 







Table 2 

Gains in Physics Achievement by 
Course for Boys and Girls** 

Boys qirlB 





M 


SD 


N 


M 


SD 


N 


Project Physics 


.07 


.70 


250 


.19 


.64 


80 


Other 


-.19 


.72 


127 


.02 


.74 


42 



♦Note — F-tests for Course and Sex are significant at the .01 level. 
♦♦Note — The scores are expressed as the residual from prediction. 
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Table 3 

Correlations of Aptitude and Environment Measures with 

Gains in Physics Achievement 

Gains 





Boys 


Qirls 


Pretest and Intelligence 


Physics Achievement (77) 


2X 


-2 


Science Understanding ( 76 ) 


22X** 


16 


Physical Science Interest (91) 


3 


6 


IQ(91) 


28X** 


29** 


Biographical Items 


Several bookcases in home 


5X 


15* 


Much non-school reading 


7 


3 


Much non-school study 


4 


-5 


Much opportunity for creativity 


5 


-6 


Often discuss occupational choice 


-3 


5 


Like school 


7 


-9 


Often question teachers 


12* 


0 


Superior marks 


18** 


11 


High persistence 


0 


-12 


Always follow through projects 


10* 


4 


Importance of intelligence 


8 


15 


High creative imagination 


12X** 


-6 


Often lead groups 


-7 


-8 


i 

Entered visual art contests 


0 


-2 


Entered science contests 


15** 


1 


Entered entertainment contests 


-1 


0 


Entered music contests 


7 


20* 


Entered writing contests 


5 


11 


Senior year in high school 


-6x 


IX 


Planning college 


13** 


1 


Personality 


Dogmatlsm(65) 


-1 


-6 


Authoritarianism(69) 


-15* 


-15 


Rigidity (68) 


1 


-16 


Achievement (78) 


10 


1 


Order (82) 


6 


-27* 


Affiliation(84) 


6 


1 


Change (75) 


12 


-10 



Table 3 
(Continued) 



Learning Environment 
Intimacy(78) 
Friction(78) 
Cliqueness(74) 
Satisfaction(80) 

Pace(77) 

Difficulty (66) 

Apathy ( 85 ) 
Favoritism (77) 
Formality (64) 
Direction( 86 ) 
Democratic ( 67 ) 

Di sorga ni za t ion ( 8l ) 
Diversity ( 58 ) 
Cognitive Press 
Non-Cognitive Press 
Class size 



Gains 

Boys 


Girls 


-2X 


-1 


-13** 


- 16 * 


-13** 


-13 


9X 


7 


-IX 


10 


13** 


16 * 


3 


4 


- 9 * 


-3X 


4X 


7 


0 


-1 


4 


3 


-9* 


-4 


OX 


-3 


19** 


18 * 


-8 


5 


1 


-10 



Note — Decimals omitted; .read correlations in hundredths. 
Those significant at the .05 and .01 levels as main effects 
in the analyses of variance are indicated with one and two 
asterisks, respectively. Variables which interacted signifi 
cantly with* instruction for a given sex group are indicated 
with an "X". Reliabilities (either Kuder-Richardson Formula 
20 or Cronbach alpha) are given in parentheses. 






Figure 1 

Mean Residual Gains for Boys in Project Physics (A) 

and Other Courses (o) 



Pre-Science Understanding 



Books in Home 



l 

r- 






4 



.2 






ir 



Low Middle High 




Bookcase Several 
or less Bookcases 




F 

df 



155,05 

6 . 27 * 

1*567 



Pre-Physics Achievement 



Creative Imagination 



Low Middle High 




Average High 
or less 




158.46 

6 . 82 ** 

1,560 



j 



IQ 



Year in School 



Low Middle High 

104 - 105-125 126 + 




Sophomores - 
Juniors Seniors 




df « 



141.26 

5 . 79 * 

1,562 

1 
A 



Note — The mean squares, F-ratios, and degrees of freedom are for 
the interaction of course effects with each aptitude; F-ratios sig- 
nificant at the .05 and* *01 levels are indicated with one and two 
asterisks, respectively. 
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Figure 2 

Mean Residual Gains for Boys in Project Physics (A) 

and Other Courses (o) 



Intimacy 

Low Moderate High 

• 21 - 




Formality 

Low Moderate High 





Satisfaction 

Low Moderate High 




F * 3.12* 

df = 2,373 



Pace 

Slow Moderate Fast 




Diverse 

Low Moderate High 





Note — The mean squares and F-ratios are for the interaction of 
course effects with each environment measure. F-ratios significant 
at the .05 and .01 levels are indicated with 1 and 2 asterisks, 
respectively. 
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Figure 3 

Mean Residual Gains for Girls in Project Physics(A) 

and Other Courses (o) 



Year in School 



Sophomores- 

Juniors Seniors 




MS = 182*17 
F-- 7*05** 

df * 1,111 



1 

f 

4 

% 
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i* 
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I 
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i 



Favoritism 

Low Moderate High 
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ms = 125 ;04 
F » 5.15 # * 

df = 1,118 



t 

'll 

j 

r- 

\ 

\ 

Note — The mean squares, F-ratios, and degrees of freedom are for 
■ the interaction of course effects with each factor; both F-ratios 
are significant and indicated with 2 asterisks. 
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